IEA INTERNATIONAL CIVIC AND CITIZENSHIP EDUCATION STUDY 2016 


Young People's Perceptions of Europe 
in a Time of Change 


Bruno Losito ° Gabriella Agrusti 
Valeria Damiani ° Wolfram Schulz 


Young People’s Perceptions 
of Europe ina Time 
of Change 


IEA International Civic and Citizenship 
Education Study 2016 
European Report 


& 
m 
> 


k ` E=ROMA 


ei Springer Open 


Bruno Losito Gabriella Agrusti 


Laboratorio di Pedagogia Sperimentale Laboratorio di Pedagogia Sperimentale 
Università degli studi Roma Tre Università degli studi Roma Tre 
Rome, Italy Università LUMSA 


Rome, Italy 
Valeria Damiani 


Laboratorio di Pedagogia Sperimentale Wolfram Schulz 
Università degli studi Roma Tre The Australian Council for Educational Research 
Rome, Italy Camberwell, Victoria, Australia 


IEA Secretariat 

Keizersgracht 311 

1016 EE Amsterdam, the Netherlands 
Telephone: +31 20 625 3625 

Fax: + 31 20 420 7136 

email: secretariat@iea.nl 

Website: www.iea.nl 


All rights reserved. No part of the publication may be reproduced, stored in a retrieval system or transmitted 
in any form or by any means, electronic, electrostatic, magnetic tape, mechanical, photocopying, recoding, or 
otherwise without permission in writing from the copyright holder 


£ The International Association for the Evaluation of Educational Achievement (IEA), 
y I EA with headquarters in Amsterdam, is an independent, international cooperative of 
Ka national research institutions and governmental research agencies. It conducts large- 

ale comparative studies of educational achievement and other aspects of education, 
with the aim of gaining in-depth understanding of the effects of policies and practices 
thin and across systems of education. 


Researching education, improving learning 


Copyedited by Paula Wagemaker Editorial Services, Oturehua, Central Otago, New Zealand 
Design by Becky Bliss Design and Production, Wellington, New Zealand 


ISBN 978-3-319-73959-5 ISBN 978-3-319-73960-1 (eBook) 
https://doi.org/10.1007/978-3-319-73960-1 


Library of Congress Control Number: 2017964509 


© International Association for the Evaluation of Educational Achievement (IEA) 2018. This book is an open access 
publication. 

Open Access This book is licensed under the terms of the Creative Commons Attribution-NonCommercial 4.0 
International License (http://creativecommons.org/licenses/by-nc/4.0/), which permits any noncommercial use, sharing, 
adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the 
original author(s) and the source, provide a link to the Creative Commons license and indicate if changes were made. 
The images or other third party material in this book are included in the book’s Creative Commons license, unless 
indicated otherwise in a credit line to the material. If material is not included in the book’s Creative Commons 
license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to 
obtain permission directly from the copyright holder. 

This work is subject to copyright. All commercial rights are reserved by the author(s), whether the whole or part of 
the material is concerned, specifically the rights of translation, reprinting, reuse of illustrations, recitation, 
broadcasting, reproduction on microfilms or in any other physical way, and transmission or information storage and 
retrieval, electronic adaptation, computer software, or by similar or dissimilar methodology now known or hereafter 
developed. Regarding these commercial rights a non-exclusive license has been granted to the publisher. 

The use of general descriptive names, registered names, trademarks, service marks, etc. in this publication does not 
imply, even in the absence of a specific statement, that such names are exempt from the relevant protective laws 
and regulations and therefore free for general use. 

The publisher, the authors and the editors are safe to assume that the advice and information in this book are believed 
to be true and accurate at the date of publication. Neither the publisher nor the authors or the editors give a warranty, 
express or implied, with respect to the material contained herein or for any errors or omissions that may have been 
made. The publisher remains neutral with regard to jurisdictional claims in published maps and institutional affiliations. 


Printed on acid-free paper 
This Springer imprint is published by the registered company Springer International Publishing AG part of 


Springer Nature. 
The registered company address is: Gewerbestrasse 11, 6330 Cham, Switzerland 


Foreword 


High-quality,large-scale comparative studies of education systems across the world en 
ng of the policies and practices that foster educational progress. They also p 
edge and research capacity. For over 60 years, the 
f Educational Achievement (IEA) has cond 
dies, with the aim of improving learning for all. 


understandi 
role in helping nations build 
International Association for 
research stu 


Educational research should 
such as mat 
role in preparing our children 
Study (ICCS) and its 


on the holistic goals of educa 


Viewed froma globa 


ematics, science, 


predecessors demonstra 


perspective, the release of 


their own 
the Evalua 


now 
tiono 


focus on more tha 
and literacy. Civica 
for life after school. The Int 
te the | 


tion. 


the resu 


students’ abil 


EA's ongoin 


CCS 20 
ng peop 


be timelier. 

prepare you 
that founda 
tru 
em 


phasizing human 


provides data, evidence, an 
citizenship in 24 countries. 
examines differences among and within countries, and provides s 
basis for comparing the find 


As in 2009, ICCS 2016 offered the partici 


tional ski 
y prosper in a world tha 


16 is the fourth | 


e to undertake their curren 
lls are i 


t requires an ope 
rights, and a focus on soci 


It also includes m 


ings of ICCS 2009 a 


pa 


d research on studen 


mportant, but that these alo 


nd 


ICCS 2016. 


ting countries t 


comprehensive core assessment with two region 


countries in Europe and the 
to measure civic and citize 
geographic regions. In the ca 
identity, recent European po 
freedom of movement 
policy. From my pers 


citizenship competencies and esta 


Euro 


supp 
the ICCS 2016 international 


pean report is se 


The report for the Latin Am 
international public-use data 
community to make best use 


n with the edu 
in order to im 


aboratio 
for ICCS 
onitoring 


nsh 


within 


ip education-rela 
se of the present 
litical and social events, suc 


report for a com 


erican region will follow in 


of the data for their own in 


cation systems participatin 
prove countries’ understan 


d on add 


of their educa 
in 


in 


between countries. 


ternational goals. ICCS 2016 provide 
dicate that students of the early 21s 
social diversity. Nevertheless, the study findings also reveal substantial levels o 
students with respect to the study’s findings, with this variation often more evident within th 


c-related c 
ided by ICCS will 


s many positive sig 


ernatio 


Its from 


tatistical 


he optio 


al student questionnai 
other for countries in Latin America. The questionnaires were d 
ted aspects of specific re 
uropean report, th 


-depth analyses. 


gin ICCS, the | 


Na 
en 


ity in relation to foundati 
nd citizenship education has an equally 
nal Civic and Citizenship 
g commitment to research focu 


this second cycleo 
EA study to investigate the ways in which education 
t and future roles as citizens. The s 
ne are not sufficient to he 
n and culture-oriented approach, a moral ori 
al justice and active political participa 
ts’ knowledge and understanding of civics and 
easures of persisting aspects of civic and cit 


ese aspects | 
has immigration from o 
European borders, and European economic condi 
pective, these aspects are fundamentally 

blishing students’ roles as citi 
f-standing, but the additional topics and fin 
ement to the international survey and report. | th 


evanc 


n of supplemen 


re components, 


able better 
ay acritical 


ucted such 


ills 
tant 
tion 
sed 


onal s 
impor 
Educa 


f ICCS could not 
systems 
tudy recognizes 
p young people 
entation 
tion. ICCS 2016 


izenship, 


inks that ensure a sound 


ting the 
one for 
esigned 
e to each of these 
cluded European 
tside Europe and 


u 


inked to deve 
zens in a chan 
dings are a useful and focu 
erefore recommend that 
prehensive critical analysis of the st 


early 2018, as will a tec 
base, and an accompanying user guide, designed to en 


EA establ 
ding of these issues. The first aim 
changes in students’ civic knowledge, attitudes, and e 
ressing new and emerging civi 
nd comparable evidence and data prov 


ngageme 
lenges. | am convinced that 
able countries to evaluate the s 
tional policies and to measure progress toward achieving national, regional, an 
nals and insights which, in com 
t century have a growing civic knowledge and respect 


tions and foreign 
loping students’ 
ging world. This 
sed 
readers consult 
udy’s findings. 


hn 
ab 


ical report, an 
ethe research 


ished two central 
focuses 
nt over time; the 
the reliab 
ths 
d 
bination, 
for 
n among 
an 


treng 


E 


variatio 


vi 


Building on the success of th 
in 2022, recognizing once again that studyi 
which needs to respond 
citizenship educat 


criti 


United Nations Su 


and 


regi 


cal componen 
agencies are 


onal addition 


ts of 
stain 
deve 
advice, and curricular guidance, a 
for 


toch 


the intern 
able 
oping or 


Europe will 


YOUNG PEOPLE'S PERCEPTIONS OF EUROPE IN A TIME OF CHANGE 


Developmen 
updatin 
ong wit 
be devel 


tG 
gc 


implementatio 
with 


scholars, an 


Council for Ed 
the Roma Tre 


express my sincere gratit 
made this report a rea 
Wolfram Schulz fr 
lytical work, critica 
llon, Tim Friedman, an 


and 
ana 
Frai 


special th 
ughtful an 


y 
o 


m 
inkiewicz (I 


th 
also gratefu 
Christian 


y sincere 
Falk Brese, 


tireless lead 
Committee (P 


this report. | tha 


Wilson for edi 


As is the case with a 
iasmoft 
pated in 
nd development of th 
onofthestudya 
ned contribution 


andenthu 
who parti 
scoping a 
and executi 
their sustai 
and 


S 
d 


Core fundi 
education 
Di 

cou 


ng 


European organ 


For ICCS 2016, th 
d technica 
study’s national research coordin 
| Researc 


anks go to t 
d scholar 
nå (Örebro Univers 
EA honorary m 
e United States), and 
| for the expert advice provid 
onseur (Un ty of Liège, Belgium), who un 
reporting procedures. 


than 
Roe 
arta Kostek, 
ersh 
EC) provided critical feedbac 
nk Seamus Hegarty on beha 


nwi 


expe 


ucationa 


University in | 


ity 
om 


d 


ne 
y gui 


Wie 


iversi 


sare also d 
Burgers, C 
Hannah Koh 
ipandcomm 


our guides ina 


ting this repor 


he nation 
the 


Euro 


lof the IE 


for the intern 


systems that participated 
rectorate-General for Edu 
ntries participating in the study and, in particular, to this 


e IEA drewo 


ude 


AC 


ity, Sweden 
ember, the 


| IEA studi 
alre 


sh 


rts. Two par 
ators 
(ACER 


taly, the lead 


ER. 


members o 


ue to the key research, operations, and man 
hristine Busch, Ralph Carstens, Juliane 

ten, Gabriela Noveanu, a 
ccess of the project. The | 
d suggested improvements to earlier versions of 
the group, as well as Paula Wagem 
tion. 


er, Andrea Net 
itment tothe su 


t and managing i 


es, ICCS 2016h 


pean option and 

e European qu 
the nati 
avee 


A's end 


€avors. 


ationa 


catio 


f of 


search coordina 


e 2009 and 2016 studi 
ng civic 
anges in national, regio 
ion (GCED) and education 
ational edu 


for 


cation 


| take place in cooperation with bot 


izations such as the European 


its established in 
tner orga 
NRCs), orga 


f the study s Proj 
dance during the study s develo 
), Cristian Cox (Univers 
etherlands), Judi 
Veugelers (University of Hu 
ed by the ICCS 2016 sampling 
dertook a tech 


an 


ts ti 


asd 


es, the | 


SUS 


citizens 
easurem 


and 


n 


ht 


Commissi 


ternationa 
nizations, i 


tion respo 


ring 
ER. 


ect 
D 


ity 


mely produc 


ependedont 
tors and their 


contributed to t 


esti 
onal level, to guidance on 


EA will con 
and citizenship ed 
nal, and internation 
tainable developme 
agenda, expressed 
oals (SDGs). At 
ivic 
hrelated m 
oped agai 


hip competenc 
ent strate 
for ICCS 2022, and that i 


duct the ne 
ucation is a 
al contexts. 
nt (ESD) w 
as part 
time, Euro 
e fra 


he same 


of Target 4.7 
pean | 
meworks, 


xt cycle of ICCS 
‘moving target’ 
Recently, global 
ere identifi 


nstit 


gies. The | 


n 


EA expects 
ts develo 


pme 
dinconsu 


tation 


he parti 


nized and imp 
, and the Laboratorio di 
organiza 
to the research team 
, namely, Gabriella Agrus 
Extended thanks go to the 
review, and overall support du 
Eveline Gebhardt from AC 


ti, Valeria Dan 


th 


th Torney-Pur 
manistic Studi 


on and th 


network of r 


nsible for this 


s for the passion, intellect, and 
niani, and Bruno Losito 
arger ICCS researc 
e drafting stage: Jo 


ment and 


nd Sa 
EA Pu 


onnaire component, through care 


cipating countries a 
e Council o 


n cooperation with 
ementedthe stud 
Pedagogia Sperimenta 


agement staff at t 
Kobelt, Paulina Korsnakova, 
for 
Editorial 


f Europe. 


esearc 
the | 


report. | would 


hn Ainley, 


Advisory Committee (PAC) for 
reporting: specifically, 
Diego Portales, Chile), Barbara Malak- 
ta (University of Mary 
es, the Netherlands). | am 
referee, Marc Joncas, and 
nical review of scaling and 


bine Weber— 
blications and 


aker an 


this publication, these individuals and 
nsured atruly successful venture. They are both the foundation 


and regional studies was provided by the 24 countries and 


in ICCS 2016. | would like to thank the 
n and Culture for providing grant support to the 
European component. 


European Commission 


dedication 
from LPS, 
h team for thei 


he | 


European 


h organizations, 
EA and 
y: the Austra 


the 
ian 


e (LPS) at 


like to 
that 


er 
T 


Julian 


their 
Erik 


and, 


EA— 


their 


d Gillian 


he criticalengagement, perseverance, 
teams fromthe 15 ed 
his report. From collaboration on the 
ful management 


ucation systems 


FOREWORD 


Finally, all of us owe our deepest gratitude to the many thousands of students, teachers, and 
school principals involved for their willingness, time, and efforts in providing the information that 
underpins this European report. Without them, this study would not have been possible. We look 
forward to the many publications, research papers, and conference contributions inspired by the 
data from this important study. 


Dirk Hastedt 
EXECUTIVE DIRECTOR, IEA 


vii 


Contents 


Foreword 
List of tables and figures 


Executive summary 
About the study 
Key findings 
Implications of findings 


Chapter 1: General overview 
Previous findings from the ICCS 2009 European regional survey 
Content and structure of the ICCS 2016 European regional questionnaire and report 
References 


Chapter 2: Students’ perceptions of their being european and students’ opportunities 
to learn about Europe at school 

Chapter highlights and summary 

Students’ perceptions of European identity 

Students’ opportunities to learn about Europe at school 

References 


Chapter 3: Students’ attitudes toward freedom of movement and immigration 
in Europe 
Chapter highlights and summary 
Students’ attitudes toward freedom and restriction of movement for European 
citizens within Europe 
Students’ attitudes toward immigration 
References 


Chapter 4: Students’ perceptions of Europe and the future of Europe 
Chapter highlights and summary 
Students’ attitudes toward cooperation among European countries 
Students’ perceptions of Europe’s future 
Students’ perceptions of the European Union 
Students’ perceptions of their life in the future 
References 


Chapter 5: Main findings and implications for policy and practice 
Summary of main findings 
Implications for policy and practice 
Outlook 
References 


Appendices 
Appendix A: Sampling information and participation rates 
Appendix B: Student percentages for dichotomous variables 
Appendix C: Item maps 
Appendix D: Organizations and individuals involved in ICCS 2016 


List of tables and figures 


Tab 


Ta 
Ta 
Ta 


Ta 


Ta 


Ta 


Ta 


e 1.1: 


e 2.1: 
e 2.2: 
e 2.3: 


e 2.4: 


e 3.1: 


e 3.2: 


e 3.3: 


e 4.1: 


e 


e4 
e4 
er, 
e4 
et. 


et, 


e A.1: 
e A.2: 
e B.1: 


Figures 


Figure 1.1: 


Figure C.1: 
Figure 2.1: 
Figure 2.2: 


ON OMS & 


Numbers of surveyed students with data from the 


questionnaire 


Students’ percept 


by gender, 


Students’ a 
Europe 


civic knowledge 


° 


ationa 


edge 


tiona 


nowledge 


nts’ trust in 


nts’ expecta 


ions of their 


ttitudes toward freedom an 


ational average scale scores indica 
of movement within 


ational average scale scores indica 
restriction of movement within 
nd level of civic knowledge 

Students’ attitudes toward equal rights for 
averages of students’ endorsement of equal rights 
average scale scores indica 
for immigrants by gender, immigrant bac 


ting stu 


ting stu 
Europe by 


ting stu 


European institutions 


nts’ expected electoral participation 


Coverage of ICCS 2016 target population 


Partici 


drestric 


den 


Europe by gender, immigra 


den 


best 


den 


European 


European identity 
National averages of students’ sense of 
National average scale scores indicatin 
immigrant background, and students’ trust in civi 
Students’ reports on their opportunities for learning about 


European identity 
g students’ sense of 


tion of move 


ts’ attitudes 


ts’ attitudes 


gender, immigran 


grants 


ts’ attitudes 
ground, and 


ts’ attitudes toward cooperation among 
average scale scores indicating students’ views on cooperation 
European countries by gender, immigrant background, and level of 


European Union 


European co 


tions for their individual future 


pation rates and sample sizes for student survey 


regional 


European identity 


c institutions 


Europe at school 


ment within 


toward freedom 


nt background, and level of 


toward 
t background, 


for immigrants 
toward equal 
level of civic 


untries 


k 

ents’ positive expectations regarding the future of Europe 

ents’ negative expectations regarding the future of Europe 
Students’ attitudes toward the 

e 

e 

e 


Percentages of students in categories for dichotomous variables 


Coun 


questionnaire 


Example of questi 
tem 


earning about 


tries that administered the 


onnaire item map 


map for the scale reflecting students’ sense of 


Europea 


European ICCS 2016 student 


n identity 


tem map for the scale reflecting students’ reports on opportunities for 
Europe at school 


25 


f 
Oo OWN O 


53 
54 


58 
59 


LIST OF TABLES AND FIGURES 


Figure 3.1: 
Figure 3.2: 
Figure 3.3: 
Figure 4.1: 
Figure 4.2: 
Figure 4.3: 
Figure 4.4: 
Figure 4.5: 


for 


ror t 


€ sca 


tne SCa 


e Sca 


ope 


ope 


erefl 


erefl 


erefl 


erefl 
ropean countries 
erefl 


erefl 


erefl 


erefl 


ecti 


ecti 


ecti 


ecti 


ecti 


ecti 


ecti 


ecti 


gst 


gst 


gst 


gst 


gst 


gst 


gst 


gst 


nts’ positi 


nts’ attitu 


titudes toward freedom of 


titudes toward restricting 


titudes toward equal rights for 


titudes toward cooperation 


ve expectations for 


nts’ negative expectations for 


des toward European 


nts’ expectations for their individual 


60 


61 


62 


63 


64 


65 


66 


67 


xi 


Executive summary 


About the study 


The International Civic an 


young peop 


a continuati 


participatio 


Inrecent ye 
co-operatio 


to assess aspec 
European soci 


importance 


The question 
attitudes toward the most pressing issues presen 
Europe to Europe, freedom of movement ac 
and of studen 
gathered data on aspects of students’ attitudes 
survey. Inclusi 


outside 


Although th 


specific civic and cit 


ICCS 2016 


as supplemen 


region. Ina 
aspects spe 


European Uni 


The Europe 
in their eigh 
German sta 


Key findi 


d Citizenship Education Study (I 
on and extensi 


n continue to change. 


ars, various political and social issues in 
n and integration of European countries. The Eu 
ts of civic and citizenship education related 
al and political situation that participating coun 
and relevance. 


naire also sought to gather information tha 


ts’ sense of European identity. In addition to th 


on of these aspects made it possible 


e general purpose of the European student qu 
izenship issues, all measures were devel 
assessment framework. The data collected w 
ting the international survey results by provi 
ddition, aspects measured in relation to the 

cifically related to integration and to p 


on (EU). 


di 


European 


an student questionnaire in 
th 
te of North Rhine-Westpha 


ia). 


ngs 


Students’ perceptions of their being European 


AsinlCCS 2 


their agreement or disagreement with a series of s 


Across part 


as Euro 
compari 
of their 


son 


Majoriti 
tru 


peans, that they were proud to live in 
results which, as in ICCS 2009, indicate a st 


European identity in almost all of the coun 


009, the European ICCS 2016 question 


tatemen 


icipating countries, majorities of surve 
Euro 
rong 
idera 


pe, and th 
sense of 
ble in 
tries 


to ICCS 2009, we observed cons 


tha 


n stronge 


Europe h 


t would a 
tly confronti 
ross the European borders, th 
is, the 
that were also collected during the 2009 ICCS 
to compare resu 


estionnaire was to investigate 
ith this instrument should be regarded 


European re 


ICCS 2016 gathered data fro 
year of schooling in 14 European countries and one benchmarking participant (t 


naire inclu 
ts 


yed stude 


creases in stude 


CCS) investigates the ways in which 


eare prepared to undertake their roles as citizens in a range of countries. ICCS 2016, 
on of ICCS 2009, was developed in response to persistent and newly 
emerging challenges of educating young people in a world w 


here contexts of democracy and civic 


ave raised concerns about the future 
ropean student questionnaire aimed 
to the European context and to the 
tries in this region consider of specific 


oration of students’ 
(e.g., migration from 
e financial crisis) 
tudent questionnaire 


low exp 
Europe 


Ng 


Uropean s 


Its across the two ICCS cycles. 


Europe- 


oped in reference to the overarching 


ther information specific to t 
gional context encompa 


practices particular tot 


ng fur e 
ss 


olicies and he 


m almost 53,000 students 
e 


ts about 
onging. 


onasking studen 
nidentity and be 


ded a questi 
on Europea 


nts stated that they saw themselves 
at they felt they were part of Europe, 
European identity and belonging. In 
nts’ positive perceptions 
in both surveys. 


participated 


es of students from non-immigrant families and students reporting a high level of 
st in civic institutions tended to express an eve 


r sense of European identity. In most 


countries, we recorded a slightly stronger sense of European identity among male students than 


am 


ong females (as previously observed in ICCS 2009). 


xiv 


YOUNG PEOPLE S PERCEPTIONS OF EU 


Students’ opportunities to learn about Europe at school 


Majorities of students sa 


across the participating countries, 83 percent of the surveyed stu 
opportunities to learn at their schools about the history of 


ROPE INA TIME OF CHANGE 


id they had opportunities to learn about Europe at school. On average 


political and economic systems at European level, about political and 
countries, and about political and economic integration between Euro 


greater extent across the 


participating European countries. 


dents reported that they had 
Europe. Opportunities to learn about 


social issues in European 
pean countries varied to a 


Students’ attitudes toward freedom of movement within Europe and toward equal rights for 


immigrants in Europe 


Most of the surveyed students endorsed freedom of movement for 
Europe. Across participating countries, large majorities of students strongly agreed or agreed with 
edom of movement for European citizens within Europe and tended to 
strongly disagree or to disagree with statements regarding restriction of movement. However, 


statements regarding fre 


we also observed considerab 
European citizens’ freedom of movement. 


knowledge scale) were m 


The European student q 
principle of providing equ 
in the ICCS 2009 studen 


Lower-secondary students with a higher level of civic knowledge (at or above Level B on the civic 
ore in favor of freedom of movement than those students with a lower 
level of civic knowledge (below Level B). Male students were more in favor than female student 
of restricting European ci 


tizens’ freedom of movement. 


tudents agreed with sta 


ifference between their 
qual rights for immigran 


toward immigrant rights. 


e variation across countries for statements endorsing restricting 


uestionnaire in ICCS 2016 measured students’ endorsement of the 
al rights and opportunities to immigrants. The inclusion of this question 
t questionnaire allowed us to compare the results between 2009 and 
016 for the European countries that participated in both surveys. 


European citizens within 


Wn 


On average, majorities of 


tements endorsing immigrants’ rights, although we also found evidence 


ICCS 2009 students’ and their ICCS 2016 students’ attitudes toward 
ts. In all countries, female students held more positive attitudes toward 


2 
S 
of differences across the European ICCS 2016 countries. Most countries recorded no strong 
d 
e 


Students’ perceptions of Europe and the future of Europe 


as more concerning for 
problematic issues. 


early all surveyed students favored cooperation among 
high levels of employment, strengthen countries’ economies, prevent and combat terrorism, and 
protect the environment. Students’ support for cooperation among 
positively associated with higher levels of civic knowledge. 


ajorities of students expressed positive expectations with respect to 
in relation to an increase in cooperation among European countries 
peace and democracy across Europe. However, students perceived som 


immigrants’ rights than males did. Students’ endorsement of equal rights for immigrants was 
positively associated with higher levels of civic knowledge (at or above Level B). In most countries, 
students from immigrant families expressed more positive attitudes than the other students did 


European countries in order to ensure 


European countries was 


Europe’s future, especially 
and the strengthening of 


e issues (such as pollution) 


the future of Europe. Students regarded terrorism as one of the most 


n most of the participating countries, majorities of students were positive about their own 
individual future. However, we observed slightly lower percentages and also more variation across 


countries with respect to students’ expectations of their future financial situation. 


EXECUTIVE SUMMARY 


Most students held positive views of the 


importance of the 


environment, strengthening the economy, an 


Mostofthe surveyed students also expressed 
Parliament. Students’ expectations of voting in 


across participating countri 


es, 


Implications of findings 


Any discussion of potentia 
the limitation 
reported results from the 


data show a number of i 


The first such finding is 


the more like 
level. These fi 
not co 


The fi 
varia 
natio 
enhan 


ntradict each other. 


ndings regarding stude 


ce students’ 


Despi 
tended to be the st 
their 
that, 
know 


edge and to facilitate 


Findings from the ICCS 2016 
nts who said they wou 


stude 
those of students who said 


level of civic knowledge. T 


curricula and developing ini 


their communities may stre 


the associ 


implications for policy and practice requires ca 
s associated with the cross-sectional design of IC 


nat 


nts'o 


te the variation observed across countries, students with 


more ope 


Europe 


they wou 


ngthen st 


as citizens at a supranational level. 


ation be 


pportuniti 


Id certain 


hese findi 
tiatives designed to support students’ en 
the impor 


trust inthe 


tween students’ perce 


ional and European identi 


but also indicate that 
pics and issues. 


n and tolerant views. 


an student survey showed 
ly or probably vote in 


ngs suggest that including 


udents’ awareness of 


CS 2016, anda 
European student questionnaire. However, the 


nteresting results that suggest possible policy implicatio 


ptions of th 
and their trust in civic institutions. The more students trusted their national civic in 
y they were to see themselves as 
ndings suggest that 


part of a broader comm 
ties can positive 


es to learn about civics and ci 
tion across countries. These findings not only support the results of previous studies on the 
nal curricula of European countries, 
earning of European to 


there 


European 
d certainly or probably vote in national and local elections. 
ICCS 2016 results also showed an association between students’ 


ex 


EU 


EU and tended to endorse statements about the 
EU in guaranteeing respect for human rights, safety in 
d sharing a set of common rules and laws. 


Europe, protecting the 


European Commission and the European 
European elections in the future varied substantially 


reful consideration of 
so with the self- 
pean ICCS 2016 
ns for the future. 


Euro 


European identity 
stitutions, 
unity at the supranational 
y coexist and do 


ú 


r 


tizenship at school showed 


is potential for schools to 


higher levels of civic knowledge 
udents expressing more tolerant attitudes. [hey were also more in favor than 
ess knowledgeable peers of cooperation among European countries. These results suggest 


through improved civic learning, schools have the potential to strengthen students’ civic 


that the national percentages of 


elections were lower than 


pectation to vote and their 
-related topics in national 
gagement at school and in 


tance of their participation 


CHAPTER 1: 


General overview 


Check for 
updates 


The International Civic and Citizenship Education Study (ICCS) investigates the ways in which 


young people are preparedtou 
acontinuation of the study initi 
educating young people in a wo 


to change (Schulz, Ain 


inth 


those linked to migrati 


achievement using a test of co 
citizenship. The study accord 
behaviors, and behavioral intenti 


that have relevance to the 


O 


ley, Frai 


ing 


ndertake 


recent years have raised concer 
European countries. Among the most pressing issues confronting E 
n and refugees, the economy (unemploymen 


and foreign and security policy 


The European student question 


E 


migration 


(Schulz, Ainley, Fraillon, 


rom outside Europe to Europe, and freedom of movemen 
Werecommend that this report be read in conjunction with th 
Losito, Agrusti, & Friedman, 2018) and with reference to the ICCS 2016 


assessment framework (Schulz 


ons related to civics and citizenship. 


(World Economic Forum, 2016). 


etal., 2016). 


naire consequently sought to gather in 
exploration of students’ attitudes toward these processes, and of st 


their roles as citizens in a range of countries. ICCS 2016, 
ated in 2009, served as a response to the emerging challenges of 
rid where contexts of democracy and civic participation continue 
lon, Losito, & Agrusti, 2016). ICCS 2016 reported on student 
nceptual knowledge and understanding of aspects of civics and 
y collected and analyzed data on students’ values, beliefs, attitudes, 


The European student questionnaire aimed to assess aspects of civic and citizenship education 
European context and to the social and political situations that countries 
s region consider have region-specific importance. Various poli 
ns about the future viability of cooperation and integration across 
urope in 2016/2017 were 
t, public finances, inflation), 


tical and social events over 


formation that would allow 
udents’ sense of European 
identity. The questionnaire also contained questions enabling investigation of issues such as 


C aCrOSS 


European borders. 


e international report onICCS 2016 


Although the 2016 European student questionnaire included items pertaining to new region- 
nship education (e.g., migration within Europe, the financial crisis, 
to address common issues), it also gathered data on aspects of students’ 


specific issues of civic a 
European cooperation 
attitudes that were co 


nd citize 


lected during the 2009 


compare data across the two ICCS cycles. 


CCS survey. This inclusion made it possible to 
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Flemish part of Belgium is an example. 
2 Malta assessed Grade 9 students given that the average age of Grade 8 students is below 13.5. In order to assess an 
age group similar to those in other Nordic countries, Norway deviated (for ICCS 2016) from the International Defined 
Target population and assessed Grade 9 instead of Grade 8. As a consequence, all Norwegian results are presented with 
an annotation. Because Norway included Grade 9 as an additional population in ICCS 2009, it is still possible to compare 
results for this country between 2009 and 2016 for the chosen target population. 
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For ICCS 2016, the word “countries” also refers to sub-regions or education systems that participated in the study. The 
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Figure 1.1: Countries that administered the European ICCS 2016 student questionnaire 


Finland 


Denmark b e Latvia 


Netherlands 


Lithuania 


Belgium (Flemish) 


Slovenia 


North Rhine-Westphalia si 
(Germany) Croatia 


Bulgaria 


m Countries with a representative national sample of student the target grade. 
m Country where only a sub-region of the country participated in the study. 


Table 1.1: Numbers of surveyed students with data from the European regional questionnaire? 


Country Number of surveyed students 
Belgium (Flemish) 2931 
Bulgaria 2966 
Croatia 3896 
Denmark 6254 
Estonia 2857 
Finland 3173 
Italy 3450 
Latvia 3224 
Lithuania 3631 
alta 3764 
etherlands 2812 
North Rhine-Westphalia (Germany) 1451 
orway 6271 
Slovenia 2844 
Sweden 3264 
Total 52,788 


3 The sampling design is described in the ICCS 2016 technical report (Schulz, Carstens, Losito, & Fraillon, forthcoming). 
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Although a majority of European students surveyed in ICCS 2009 demonstrated knowledge of 
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evident. 
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YOUNG PEOPLE'S PERCEPTIONS OF EUROPE INA TIME OF CHANGE 


Content and structure of the ICCS 2016 European regional 


questio 
The ICCS 


aimed ati 
civics and 
Studen 
the i 
Stud 
inclu 


Stud 
was 


St 


en 
de 


en 
inc 


ude 


esti 


Stud 
Stud 
Stud 
Stud 


e 
en 


en 
en 


Gy 


tude 
new 


tuden 


re 


srela 


tuden 
t scho 


tuden 


tuden 


e resu 
strumen 


uestionn 


nvestigating students i 


ts' views on cooperatio 
CS 2016. 


ts’ percepti 
ts’ percepti 
ts’ percepti 
ts’ attitude 


ts’ views on 
question for ICCS 201 


ts’ percepti 


port does not present find 
er, it focuses on students’ at 


nnaire and report 
2016 


European regiona 


' 
citizenship issues: 


ts’ perceptions of their 


ts’ reports on opportun 
din ICCS 2009 but was 


ts’ views on 


European ci 


nts’ attitudes toward immigration. 1 
ternational) student questionnaire, and th 
onnaire. 


ons of discri 
ons of the fu 


ons of their 


s toward po 


the age at w 
6 


ons of the 


ti 
ted to the European con 


ol; 


ts’ perceptions of Europ 


aire). 


is report has five chapters. Chapter 2 exam 
pportunities students have to learn about 
ttitudes toward freedom and restriction of m 


n among 


minatio 


ife in the fu 


itical and et 


ts’ perceptions of their being 


ts’ attitudes toward freedon 


ts presented in this report also do 
ts. However, some data regarding 
ntext are included (specifically, data related 


terest in and opin 


uropean identity. This 


tems relating it were not modified for ICCS 2016. 


ities to learn about 


esame 


European co 


n in Europe (a 


ture of 


instrument consisted of a questionnaire pri 
affective and behavioral domains. It included 11 questions (with Likert-type res 
ions regarding the followin 


Europe at school. A sim 


modified for ICCS 2016. 
tizens freedom to reside and work within 
uded in ICCS 2009 but was modified for inclusion in ICCS 2016. 


[his question was included in the ICCS 2009 


marily focused on 
ponse categories) 
g Europe-specific 


question was included in ICCS 2009, and 


ilar question was 


Europe. This question 


items were used for the 2016 European 
untries. This question was a new one for 


new question for ICCS 2016). 
uestion for ICCS 2016). 


Europe (new q 


kb 


ropean Union (a new 


ings from all questions i 
tudes and perceptions toward 


text: 


ean 


No 


CO 


urope at 
ovement 


ture (new qu 


ich young people should 


European and students’ opportunities to learn about 


n and restriction of movement and immigration in 


t include findings based on th 
topics that are relevan 
European options 


ines students’ sense of 


estion for ICCS 2016). 


hical consumerism (new question for ICCS 2016). 


acquire different rights and obligations 


question for ICCS 2016). 


n the European student questionnaire. 


three civic and citizenship content 


Europe 


Europe; 


d the future of Europe. 


e international 
t to the European regional 
forming part of the student 


ty and the 
students’ 
urope and 


European ident 
school. Chapter 3 focuses on 
for European citizens within E 


4 The metric of the European regional questionnaire, as in all |CCS 2016 questionnaire scales, was set to a mean of 50 
and a standard deviation of 10 for equally weighted national samples that had met sample participation requirements. 
For two scales (measuring students’ sense of European identity and endorsement of equal rights and opportunities for 
immigrants), the scores were set to the same metric as in |CCS 2009, so that in these cases 50 reflects the ICCS 2009 
average (with equally weighted national samples) and 10 the corresponding standard deviation. 


GENERAL OVERVIEW 


toward the principle of providing equal rights and opportunities to immigrants. Chapter 4 reports 
on students’ perceptions of the future of Europe and of their individual futures. It also covers 
students’ perceptions of the EU. In the final chapter, Chapter 5, we discuss possible implications 
of the main findings for policy and practice. 
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CHAPTER 2: 


Students’ perceptions of their being 
European and students’ opportunities to 
learn about Europe at school 


Chapter highlights and summary 


Surveyed students expressed a strong sense of European identity and belonging. 


e Across participating countries, majorities of students indicated that they saw themselves 
as Europeans, were proud to live in Europe, and felt they were part of Europe. (Table 2.1) 


e During the period between ICCS 2009 and 2016, students’ positive perceptions of their 


European identity increased in the majority of countries. (Table 2.2) 


e In most participating countries, male students tended to express a slightly stronger sense 


of European identity than female students did. (Table 2.3) 


Majorities of students from an immigrant family held a weaker sense of European identity 


than did students from a non-immigrant family. (Table 2.3) 


Consistent and statistically significant positive associations were observed between 


students’ sense of European identity and students’ level of trust in civic institutions. 


(Table 2.3) 


Majorities of students said they had opportunities to learn about Europe at school. 


e Most surveyed students reported having learned about the history of Europe at school. 


(Table 2.4) 


e Opportunities, as reported by students, to learn about political and economic systems 


at the European level, about political and social issues in 


European countries, and about 


political and economic integration between European countries varied across the ICC 


2016 participating countries. (Table 2.4) 
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Table 2.2: National averages of students’ sense of European identity 


Country 2016 2009 Differences 
(2016-2009) 40 45 50 55 60 
Belgium (Flemish) 52 (0.3) Vv 9 (0.2 2.8 (0.8) = E 
Bulgaria 5205 x 5G@ (02 2.1 (0.8) WE 
Croatia 55 (0.3) A - L] 
Denmark? 55 02) WV. 19 (0.2 4.1 (0.8) | E 
Estonia! 53 (0.3) 50 (0.3) 3.1 (0.8) E BB 
Finland 56 (0.2) A 52 (0.2 4.4 (0.8) a m 
taly 54 (0.2) A 54 (0.2 0.3 (0.8) Oo 
atviat 48 (0.2) Y 5 (03 3.1 (0.8) W m 
Lithuania 54 (0.3) 19 (0.2) 4.4 (0.8) D E 
alta 54 (0.2) A 18 (0.3 5.8 (0.8) E E 
etherlands* 52 (0.3) V - - E) 
orway (9)! 55 (Oy A - - m 
Slovenia 55 (0.2) A 53 (0.3 1.3 (0.8) | 
Sweden? 53 (0 50 (0.2) 4.0 (0.8) E WW 
European ICCS 2016 average 59 (O1) 
Common countries average 55 OD 48 (0.3 8 (O02) 
Benchmarking participant not meeting sample participation requirements 
North Rhine-Westphalia 51 (0.3) - - 
ismi 
(Germany)! 
Jl] 2016 average score +/- Confidence interval 
II] 2009 average score +/- Confidence interval 
National ICCS 2016 average On average across items, students with a score in the range with this color 
A More than 3 score points above European ICCS 2016 average have more than a 50% probability of indicating: 
A Significantly above European ICCS 2016 average No strong agreement with positive statements 
V Significantly below European ICCS 2016 average Strong agreement with positive statements 


WY More than 3 score points below European ICCS 2016 average 


() Standard errors appear in parentheses. 

Statistically significant changes (p < 0.05) between 2009 and 2016 are displayed in bold. 

(9) Country deviated from International Defined Population and surveyed adjacent upper grade. 
+ Met guidelines for sampling participation rates only after replacement schools were included. 
1 National Defined Population covers 90% to 95% of National Target Population. 

- No comparable data available. 


group had significantly (p < 0.05) higher values; the green bars indicate score-point differences 
where the other group had significantly higher averages.° 


In most countries, male students tended to express a slightly stronger sense of European identity 
than females (as already observed in ICCS 2009). On average, we recorded a small but statistically 
significant difference of one score point between males and females. Students from an immigrant 
family expressed a weaker sense of European identity compared to students from a non-immigrant 
family. On average, the difference between the two groups was four scale score points. Estonia, 
Latvia, Lithuania, and the Netherlands recorded the largest differences (seven score points or 
more).° 


Werecorded consistent and statistically significant positive associations between students sense 
of European identity and students trust in civic institutions. On average across the European 


5 Results from the benchmarking participant North Rhine-Westphalia (Germany) were not included because North 
Rhine-Westphalia's very low sample response rates do not permit comparison across sub-groups within the sample. 

6 Inall participating countries, the socioeconomic status (SES) of students from a non-immigrant family was statistically 
significantly higher than the socioeconomic status of students from an immigrant family. Latvia was the only country not 
to register a statistically significant difference between the SES of students from an immigrant family and those from a 
non-immigrant family. 
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countries, the difference between students reporting a high level of trust and the students 
reporting a low level of trust was five score points on the European identity scale.’ 


Students’ opportunities to learn about Europe at school 


Most European countries consider civic and citizenship education a relevant area of school 
education (Eurydice, 2005, 2012; Kerr et al., 2010). At the same time, as evident in several 
studies, this area of the school curriculum is still characterized by gaps between policies and 
practices and between intended and implemented curricula (see, for example, Birzéa et al., 2004; 
Veugelers, de Groot, & Stolk, 2017). Although these studies emphasize the extent of difference 
across the European countries in how they deliver civic and citizenship education, they identify 
five approaches overall: 


1) Taught as aseparate subject by teachers of subjects related to civic and citizenship educatio 


oat 


2) Taught by teachers of subjects related to human and social sciences; 


(3) Integrated into all subjects taught at school; 


4) Taught as an extracurricular activity; and/or 


5) Considered to be a result of school experience as a whole. 


The ICCS 2009 results showed that these five approaches often coexist across the participating 
European countries (Schulz, Ainley, Fraillon, Kerr, & Losito, 2010). 


Data relating to the aims of civic and citizenship education drawn from the ICCS 2016 national 
contexts survey revealed a great deal of commonality in civic and citizenship education learning 
objectives across the European countries. Results from questions in the ICCS 2016 school and 
teacher questionnaires that asked principals and teachers to select the three most important aims 
of civic and citizenship education also showed general cross-national agreement that these three 
aims related to development of students’ civic and political knowledge and skills (e.g., promoting 
knowledge of social, political, and civic institutions; promoting students’ critical and independent 
thinking). The other aims included in the question concerned the development of a sense of 
responsibility (e.g., promoting the capacity to defend one’s own point of view) and the development 
of active participation (e.g., preparing students for future political engagement).® 


Having examined the European dimension included in civic and citizenship curricula, the authors 
of the 2012 Eurydice report (Eurydice, 2012) concluded that this dimension is relevant in the 
majority of European countries. They also observed that this dimension addresses such matters 
as European identity and belonging; European history, culture, and literature; the main economic, 
political, and social issues facing Europe; the functioning of European Union institutions; and 
European Union perspectives. 


According to the Eurydice report, national curricula at the lower secondary level of education 
(ISCED Level 2) in the majority of the European countries participating in ICCS 2016 cover the 
themes identified in the report.? Norway and Sweden were the only countries where the issue of 
European identity and belonging was not a recommended topic in the curriculum. Norway also, 
along with Malta, did not include content relating to Europe’s main economic, political, and social 
issues. The Norwegian curriculum at lower secondary level, moreover, gave no consideration to 
issues related to how institutions function; nor did it include European Union perspectives. 


7 ICCS 2016 used six items (national government, local government, national parliament, police, courts of justice, political 
parties) to derive a scale reflecting students’ trust in civic institutions (see Chapter 5 of the ICCS 2016 international 
report; Schulz et al., 2018). Chapter 4 of this current report presents results for students’ trust in the European 
Parliament and in the European Commission (see, in particular, Table 4.6). 

8 For more detailed information on the European school contexts, see Chapters 2 and ó of the international ICCS 2016 
report (Schulz et al., 2018). 

9 Data for Croatia on citizenship education themes included in national curricula (ISCED 1-3) for school year 2010/2011 
were not available in the 2012 Eurydice report. 
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Table 2.4: Students’ reports on their opportunities for learning about Europe at school 
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Percentages of students who have had opportunities to learn to a large 
or to a moderate extent at school about the following topics: 


Country Political and The history of Political and Political and Average scale 
economic systems Europe social issues in economic scores for students’ 
of other (%) other European integration reporting on 
European countries between European | opportunities for 
countries %) countries learning about 
(%) (%) Europe at school 
Belgium (Flemish) 57 (1.5) V 74 (1.6) VvV 53 (1.3) V 57 (1.3) V 47 (0.3) Y 
Bulgaria 55 (1 a TAO) sZ Bye} (lo y CONGEST: 48 (0.3) V 
Croatia 71012) A 92 (0.7) A 73 (1.1) A 74 (1.2) A 53 (0.3) A 
Denmark! JORGO TA T CS NT. O51 CO A 68 (1.0) A 50 (0.2 
Estonia! 52 (14 Y 89 (0.8) A 51 (12) V 50 (1.4) Y 48 (0.2) V 
Finland SREL, te EE EE Z Gu) EAS Don OD) EAS 
taly 81 (0.8) A 89 (0.7) A 80 (0.9) A 81 (0.9) A 54 (0.3) A 
Latvia? SAA 82 (0.9 eye (ile) vA SON (A) w 48 (0.3) V 
Lithuania 78 (1.1) A 93 (0.6) A 76 (1.1) A 83 (0.9) A 55 (0.3) A 
alta 593(0!8) V 66 (O17), y 5207) 7v 58 (0.8) V 47 (0.2) V 
etherlands' 53 (1.4) Y 83 (1.3 52 (1.5) Y 53 (1.3) Y 47 (0.3) Vv 
orway (9)! TANO A E 69 (0.9) A 66 (1.0 GE 
Slovenia 74 (1.1) A 78 (0.9) Vv 65 (1.2) A 71 (1.0) A 50 (0.2 
Sweden? ESAT) SELAKO y 62 (1.4) EE 49 (0.3) V 
European ICCS 2016 average 66 (0.3) 83 (0.2 63 (0.3) os (OS SOOM 
Benchmarking participant not meeting sample participation requirements 
North-Rhine-Westphalia 66 (1.8) TS Z (2 1) 64 (1.8 49 (0.5 


(Germany): 


National ICCS 2016 percentage or average: 
A More than 10 percentage points or 3 score points above European ICCS 2016 average 
A Significantly above European ICCS 2016 average 
V Significantly below European ICCS 2016 average 
WY More than 10 percentage points or 3 score points below European ICCS 2016 average 


Notes: 


() Standard errors appear in parentheses. Because results are rounded to the nearest whole number, some totals may appear inconsistent. 


Met guidelines for sampling participation rates only after replacement schools were included. 


(9) Country deviated from International Defined Population and surveyed adjacent upper grade. 
H 
1 


National Defined Population covers 90% to 95% of National Target Population. 
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CHAPTER 3: 


Students’ attitudes toward freedom of 
movement and immigration in Europe 


Chapter highlights and summary 


Surveyed students endorsed freedom of movement for European citizens within Europe. 


e Large majorities of students across the European participating countries strongly agreed 
or agreed with statements regarding freedom of movement for European citizens within 
Europe and tended to strongly disagree or disagree with statements regarding restriction 
of movement. (Table 3.1) 


e Strongvariation across countries was observed for statements on restriction of movement. 
(Table 3.1) 

e Students with a higher level of civic knowledge (at or above Level B on the civic knowledge 
scale) were more in favor of freedom of movement than were students with a lower level 
of civic knowledge (below Level B). (Tables 3.2, 3.3). 


e Malestudents were more in favor than female students of restricting freedom of movement. 
(Table 3.3) 


Differences related to students’ endorsement of equal rights for immigrants were evident 
across the European participating countries. 

e Most students largely agreed with statements regarding immigrants’ rights. (Table 3.5) 

e Most of the European participating countries recorded no strong difference between 


their ICCS 2009 students’ and their ICCS 2016 students’ attitudes toward equal rights 
for immigrants. (Table 3.6) 


n all countries, female students held more positive attitudes toward immigrants’ rights 
than males did. (Table 3.7) 


e In most countries, students from an immigrant family expressed more positive attitudes 
toward immigrant rights than students from a non-immigrant family did. (Table 3.7) 


e Students’ attitudes toward equal rights for immigrants were associated with higher levels 
of civic knowledge (at or above Level B). (Table 3.7) 
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Table 3.4: Students’ attitudes toward equal rights for immigrants 
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Percentages of students who agreed or strongly agreed with the 
following statements: 
Country Immigrants should | Immigrant children Immigrants who Immigrants should | Immigrants should 
have the should have the live in a country have the have the same 
opportunity same opportunities | for several years opportunity to rights that 
to continue for education that should have the continue their own everyone else in 
speaking their other children in opportunity to customs and the country has 
own language the country have vote in elections lifestyle 
Belgium (Flemish) 58 (1.2) Y 94 (0.5) A 77 (1.0) A 66 (1.2) V 88 (0.8 
Bulgaria St 86 (0.9) y SS A 75 GENTA 76 (1.1) e 
Croatia 79 (1.1) A 95 (0.5) A 78 (1.0) A 84 (0.9) A 92 (0.7) A 
Denmark! lafe 5 OAI A 86 (0.7) A TO LOTA 90 (0.7) A 
Estoniat 62 (1.2) V 94 (0.5 68 (1.1) V 59 (1.1) Y 85 (0.8) V 
Finland 68 (1.0) KOE Av 738(019) A 65 (LO) 89 (0.7) A 
taly 65 (1.0) Vv 94 (0.5) A 76 (1.1) 73 (1.0) 92 (0.6) A 
Latvia? SOLES) Y 88 (0.7) V SON Toy 54 (1.4) Y TEKO y 
Lithuania 80 (1.0) A 95 (0.5) A 70 (1.0) Vv 82 (0.8) A 88 (0.7 
alta 79 (0.9) A 90 (0.6) V 67 (O19) 7. 72 108 CLA y 
etherlands! 51 (1.5) Y 92 (0.5) 80 (0.9) A 70 (1.2) V 87 (0.9 
orway (9)1 Ths (OLD 7K, KOH A 84 (0.6) A Sin Ome 92 (0:4) TA 
Slovenia 73 (1.2) A 95 (04) A 82 (0.9) A 79 (1.0) A 92 (0.7) A 
Sweden? 82 (1.2) A 25 (05 A 88(09) A 82 (LOTA 94 (0.7) A 
European ICCS 2016 average 68 (0.3) Ser oul 75 OS) oe 88 (0.2 
Benchmarking participant not meeting sample participation requirements 
North-Rhine-Westphalia 32 (9) 93 (0.8 83 (12) Hee ales) 22 (10 
(Germany): 


National ICCS 2016 percentage: 
A More than 10 percentage points above European ICCS 2016 average 


AS 
VS 


ignificantly above European ICCS 2016 average 
ignificantly below European ICCS 2016 average 


WY More than 10 percentage points below European ICCS 2016 average 


Notes: 
() Standard errors appear in parentheses. Because results are rounded to the nearest whole number, some totals may appear 


in 


consistent. 


(9) Country deviated from International Defined Population and surveyed adjacent upper grade. 
t+ Met guidelines for sampling participation rates only after replacement schools were included. 


1 N 


ational Defined Population covers 90% to 95% of National Target Population. 
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Inevery country, students’ scores on the scale were greater for students with a higher level of civic 
knowledge scores (at or above Level B) than for students with a lower level of civic knowledge 
(below Level B). On average, the difference was about two scale points. 
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Table 3.5: National averages of students’ endorsement of equal rights for immigrants 


Country 2016 2009 Differences 
(2016-2009) 40 45 50 55 60 

Belgium (Flemish) 47 (0.2) V 46 (0.3) 1.6 (O.8) m 
Bulgaria 46 (0.3) y 52 (0 2) -5.6 (0.7) im i 
Croatia 50 (0.2) A - E 
Denmark! 49 (0.2) 48 (0.3) 0.0 (0.7) P 
Estonia! 46 (0.1) VM 48 (0.2) -1.7 (0.7) ig 
Finland 48 (0.2) VM 48 (0.3) -0.2 (0.7) mj 
taly 49 (0.2) 48 (0.3) 0.1 (0.8) D 
Latvia! 43 (0.2) v 47 (0.2) -3.4 (0.7) E E 
Lithuania 49 (0.2) A 51 (0.2) -1.6 (0.7) CH! 

alta 48 (0.2) 49 (0.3) -1.0 (0.8) m 

etherlands! 47 (0.3) Vv - - im 

orway (9)! 51 (02) A 48 (0.4) 2.8 (0.8) = m 
Slovenia 50(03 A 50 (0.3) -0.3 (0.8) Kl 
Sweden? 53 (0.4) A 52 (04) kee (e 
European ICCS 2016 average 48 (0.1) 
Common countries average 48 (0.1) 48 (0.3) -0.6 (0.2) 
Benchmarking participant not meeting sample participation requirements 
North Rhine-Westphalia Ber (@5) - - = 
(Germany): 

BW 2016 average score +/- Confidence interval 
II] 2009 average score +/- Confidence interval 

National ICCS 2016 average: On average across items, students with a score in the range with this color 
A More than 3 score points above European ICCS 2016 average have more than a 50% probability of indicating: 
A Significantly above European ICCS 2016 average No strong agreement with positive statements 
V Significantly below European ICCS 2016 average Strong agreement with positive statements 


WY More than 3 score points below European ICCS 2016 average 


Notes: 

() Standard errors appear in parentheses. 

Statistically significant changes (p < 0.05) between 2009 and 2016 are displayed in bold. 

(9) Country deviated from International Defined Population and surveyed adjacent upper grade. 
+ Met guidelines for sampling participation rates only after replacement schools were included. 
1 National Defined Population covers 90% to 95% of National Target Population. 

- Nocomparable data available. 
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Chapter highlights and summary 


Nearly all surveyed students endorsed cooperation among European countries on specific 


issues. 


e Statements related to coopera 
countries’ economies, preventing and combating terrorism, and protecting the environment 
attracted the higher levels of agreement. (Table 4.1) 


e Associations between studen 
high civic knowledge scores (at or above Level B on the civic knowledge scale) were 
observed. (Table 4.2) 


tion in guaranteeing high levels of employment, strengthening 


ts’ views on cooperation among European countries and 


Majorities of students expressed positive expectations with respect to Europe's future, 


although some issues raised concern. 


e Students believed that cooperation among European countries would probably increase 
and that peace and democracy across Europe were likely to strengthen. (Table 4.3) 


e Students viewed terrorism and the influence of non-European powers as the most 
problematic issues. (Table 4.4) 


Most students held positive views of the EU 


e Majorities of students tended to agree with statements related to the role of the EU in 
ng respect for human rights, safety in Europe, protecting the environment, 
strengthening the economy, a 


guaranteel 


e Most of th 


European Parliament. (Table 4. 


nd sharing a set of common rules and laws. (see Table 4.5) 


e surveyed students expressed trust in the European Commission and the 


e Students’ expectations of voti 


countries. 


see Table 4.7) 


6) 


ng in European elections in the future varied across 


Nearly all surveyed students had positive perceptions of their own life in the future. 


e In most of the participating countries, majorities of students were positive about their 
respective futures. The extent to which students thought their financial situation would 
be better than that of their parents varied across countries. (Table 4.8) 
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This huge flow of migrants has caused tension among EU member states about asylum-seeker 
relocations, particularly because the number of asylum applications is not equally allocated across 
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EU countries. In 2015, five member states (Germany, Hungary, Sweden, Austria, and Italy) registered 
75 percent of all asylum applications (Sabbati, 2016). Another critical issue pertains to the transit 
countries. Typically overwhelmed by the ongoing stream of arrivals and the commensurate strain of 
providing basic humanitarian assistance, these countries have been requesting EU assistance. The 
restoration of internal border controls among EU countries, thus limiting freedom of movement 
across the Schengen Area countries, has been one of the most striking effects of the tension that 
has arisen among member states because of this mass movement of people / 


The ICCS 2016 European regional questionnaire included a set of eight items investigating 
students’ attitudes toward cooperation among European countries. This question sought to capture 
n 
c 


students’ views on the adoption of common policies in Europe (e.g., environmental policies) or o 
cooperation in specific areas (e.g., strategies to reduce unemployment and to address economi 
crises). 


5 na 


More specifically, the question asked students to “strongly agree; “agree; “disagree,” or “strongly 
disagree” with the following statements: (a) “European countries should cooperate to protect 
the environment (e.g. through programs to limit pollution, programs to combat climate change);” 
(b) “European countries should cooperate to guarantee high levels of employment;” (c) “European 
countries should cooperate to strengthen their economies;” (d) “European countries should 
recognize all educational qualifications achieved in any other European country;” (e) “European 
countries should have a European army for peacekeeping missions;” (f) “European countries 
should cooperate to prevent and combat terrorism;” (g) “European countries should cooperate to 
combat illegal entry from non-European countries;” and (h) “European countries should cooperate 
to provide shelter to people escaping persecution in their countries for reasons of race, religion, 
or political opinions.’ 


The subsequent eight-item scale had a satisfactory average reliability (Cronbach's alpha = 0.79 for 
the combined international dataset), with the positive scale scores reflecting more positive attitudes 
toward cooperation between European countries (see the item map in Figure 4.1, Appendix C). 


Nearly all of the surveyed students favored cooperation among European countries. Across 
these countries, the average percentages agreeing with the statements ranged from 84 percent 
(European countries should have a European army for peacekeeping missions) to 98 percent 
(European countries should cooperate to protect the environment). There was therefore little 
variation in the extent of agreement with the statements, as is also evident from the European 
ICCS average percentages in Table 4.1. 


Table 4.1 also records the national averages for participating countries on this scale (i.e., students’ 
attitudes toward cooperation among European countries). The highest average score that we 
recorded was for Croatia with 54 score points. 


When we examined the association of students’ views on cooperation among European countries 
with students’ gender, students’ background (student from an immigrant family versus student 
from a non-immigrant family), and civic knowledge, we found only a few substantial differences 
in terms of gender and immigrant status (see Table 4.2). Males were significantly less positive 
than females in Belgium (Flemish), Denmark, the Netherlands, and Sweden, while students from 
non-immigrant families in Denmark, Estonia, Italy, and Latvia held more positive attitudes toward 
cooperation than their immigrant peers did. Sweden was the only country in which students from 
an immigrant family scored higher than students from a non-immigrant family on the cooperation 
scale (two points higher on average). 


1 We need to stress that the European regional questionnaire was developed before the mass movement of refugees. 
Recent growth in the numbers of refugees in many European countries was not reflected in the development of the 
ICCS 2016 study, and the European regional student questionnaire addressed this topic in one item only. However, the 
mass movement of refugees was a relevant issue at the time the European regional questionnaire was administered and 
may have influenced students’ answers. 
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In all countries, the students with a higher level of civic knowledge were the students who expressed 
the more positive views on adoption of common policies and on cooperation among European 
countries. On average, the statistically significant difference between students with higher and 
lower levels of civic knowledge was four scale points. 
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2 Findings from the Standard Eurobarometer 86 survey (European Commission, 2016b) showed that half of the 
respondents were optimistic about the future of the EU. Among the students participating in the European ICCS 2016 
survey, those in Lithuania and Malta were the most optimistic about Europe's future, while those in Italy and Sweden 
were the least optimistic. 
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Table 4.3: Students’ positive expectations regarding the future of Europe 
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Percentages of students who expected that the following positive scenarios 


may likely or very likely happen in Europe: 


Country There will be There will be There will be Democracy will be Average scale 
stronger greater peace less air and water strengthened scores for 
cooperation among across Europe pollution in across Europe students reporting 
European %) Europe (%) on positive 
countries (%) expectations of the 
(%) future of Europe 
Belgium (Flemish) 86 (0.7 64 (1.2) 43 (1.1) V 79 (0.9) 49 (0.2) Vv 
Bulgaria 80) Sy SINY SONIT A 64 (1.1) / AG O:3) V 
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Denmark’ O25 (OIS)\ TA FEAL SE 57 (0.8 A 88 (0.6) A SOA TA 
Estoniat 87 (0.8 62 (1.2) 42 (1.3) V 76 (0.8) 49 (0.3) V 
Finland 91 (0.6) A (10 52 (lal A 84 (0.6) A S(O) A 
taly 88 (0.5) A 76 (0.8) A 47 (1.0) 79 (0.8) 50 (0.2) A 
Latvia? CS OA V S V SEIT E 4920 x 
Lithuania 90 (0.6) A 59 (1.1) V 41 (1.0) Vv 78 (0.8) 50 (0.3) 
alta 87 (0.5 69 (0.8) A 52 (0.9. A 81 (0.6) A 5 (0.220 TA 
etherlands! 89 (06) A 73 (1.2) A 52 (1.2) A 79 (0.8) 51 (0.3) A 
orway (9)! 29 (@5 A 62 (0.7) V 50 (0.8 A 32107A 50 (0.1) 
Slovenia 79 (0.9) V 49 (1.2) Y 40 (1.0) V 74 (1.1) V 48 (0.3) V 
Sweden? 86 (0.8 TORTA 48 (1.0 82 (0.9) A 51(0:2) A 
European ICCS 2016 average 86 (0.2 64 (0.3) ALTE (OVS) 78 (0.2) 50 (0.1) 
Benchmarking participant not meeting sample participation requirements 
North-Rhine-Westphalia 74 (15 52 (17) 43 (45 75 ES) 48 (0.4) 
(Germany): 


National ICCS 2016 percentage or average: 
A More than 10 percentage points or 3 score points above European ICCS 2016 average 
A Significantly above European ICCS 2016 average 
V Significantly below European ICCS 2016 average 
WY More than 10 percentage points or 3 score points below European ICCS 2016 average 


Notes: 


() Standard errors appear in parentheses. Because results are rounded to the nearest whole number, some totals may appear inconsistent. 
(9) Country deviated from International Defined Population and surveyed adjacent upper grade. 
+ Met guidelines for sampling participation rates only after replacement schools were included. 
1 National Defined Population covers 90% to 95% of National Target Population. 


Slovenia (Table 4.4). 


nfluence on 
ICCS 2016 average in 


About 67 percent of students anticipated that non-European 
Europe. We recorded percentages that were more t 
Denmark and more than 10 points below in Bulgaria and Croatia. 


On average, 43 percent of surveyed students believed that t 
European countries; 52 percent envisaged a rise in poverty an 


and Slovenia recorded percentages more than 10 points above the 
statement). Of the participating countries, 


European countri 


rrorism will be more of a threat all across 
es). The students who were most 
gium (Flemish), Italy, Malta, and 


powers would have an 
han 10 points above the 


he economy would weaken in al 
d unemployment in Europe (Italy 
European ICCS average for this 
Denmark recorded the lowest percentages of agreement 


The percentages of students holding this negative expectation varied markedly across the countries, 
with the range extending from 68 percent (Te 
to 43 percent (The economy will weaken in all 

likely to anticipate an increase in terrorism were those in Be 


Europe 


increased 
European 
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Table 4.4: Students’ negative expectations regarding the future of Europe 


Percentages of students who expected that the following negative scenarios 
may likely or very likely happen in Europe: 
Country Terrorism will be Europe will be The economy There will be Average scale 
more of a threat more influenced will be weaker arise in poverty scores for student 
all across by non-European in all European and unemployment disagreement 
Europe powers like China, countries in Europe with negative 
(% India, and (%) (%) expectations of the 
the United States future of Europe 
(%) 
Belgium (Flemish) 73 (1.0) A 67 (1.3 43 (1.3) 55 (1.2) A 49 (0.2) V 
Bulgaria Leg DY A6 (1.1) A SONGZ EA S(O) A 
Croatia 69 (1.1 50 (1.2) Y 39 (1.0) V 53° (4.4 51 (0.3) A 
Denmark! 68 (0.8 79 (0.9) A 30 (0.8) Vv 36 (0.9) / 52 ODT A 
Estoniat 67 (1.1 69 (1.1 42 (0.9) 49 (0.9) V 50 (0.2 
Finland roy (ileal OFONA 45 (0.9) A AT (02) y 50 (0.2) A 
taly 77 (0.8) A 77 (0.8) A 2 UH -A 64 (0.9) A 47 (0.2) v 
Latvia? 69 ABEE 66 (1.2 44 (1.1) SANO Sl (OBA 
Lithuania 61 (1.0) Vv 69 (1.1 38 (1.3) V 44 (1.0) V 52 (0.2) A 
alta TE (Ou) s 65 (0.8) V 50 (05) EE 48 (0.2) V 
etherlands' 68 (1.2 64 (1.2) V 37 (1.5) V 43 (1.2) V 51 (0.3) A 
orway (9)1 63 (0.7) V ODOM) aA 49 (0.6) A ONA 50 (0.1 
Slovenia 75 (1.1) A 73 (0.9) A 50 (1.1) A 67 (1.0) A 47 (0.2) V 
Sweden? SOD y (g; s S o Yy EGED V7. slit (02) Ee 
European ICCS 2016 average 68 (0.3 67 (0.3 43 (0.3) 52 (O38 50 (0.1 
Benchmarking participant not meeting sample participation requirements 
North-Rhine-Westphalia TIA 54 (1.6 A3 (2.0) 52 (1.6 50 (0.3 
(Germany)! 
National ICCS 2016 percentage or average: 
A More than 10 percentage points or 3 score points above European ICCS 2016 average 
A Significantly above European ICCS 2016 average 
V Significantly below European ICCS 2016 average 
W More than 10 percentage points or 3 score points below European ICCS 2016 average 
Notes: 
() Standard errors appear in parentheses. Because results are rounded to the nearest whole number, some totals may appear inconsistent. 
(9) Country deviated from International Defined Population and surveyed adjacent upper grade. 
t+ Met guidelines for sampling participation rates only after replacement schools were included. 
1 National Defined Population covers 90% to 95% of National Target Population. 
with these statements (more than 10 percentage points below the European ICCS 2016 average). 
Table 4.4 also shows the national average scale scores for students’ disagreement with statements 
indicating negative expectations of Europe's future. The average scale scores for students in 
Bulgaria, Croatia, Denmark, Finland, Latvia, Lithuania, the Netherlands, and Sweden were all 
significantly above the European ICCS 2016 average. 
The ICCS 2016 international student questionnaire asked students how concerned they felt about 
potential threats to the world’s future (e.g., pollution, global financial crisis, violent conflict, climate 
change, unemployment, terrorism). Some of these aspects align with the topics included in the 
items in the European ICCS 2016 student questionnaire that sought to record students’ positive 
and negative expectations with respect to Europe in the future. The students from the European 
countries considered pollution and terrorism to be main threats to the world’s future, but deemed 
crime, violent conflict, financial crises, and unemployment as less serious.’ 


3 For further details, see Chapter 5 of the ICCS 2016 international report (Schulz, Ainley, Fraillon, Losito, Agrusti, & 


Friedman, 2018). 
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Table 4.8: Students’ expectations for their individual future 


Percentages of students who expected that the following may likely or very likely happen: 
Country | will find a My financial | will finda | will have the Iwill earn 
steady job situation will be job | like opportunity to enough money to 
(%) better than that (%) travel abroad start a family 
of my parents for leisure (%) 
(%) (%) 
Belgium (Flemish) 98 (0.3) A 68 (1.1) Y 94 (0.5 A 96 (0.5) A 98 (0.3) A 
Bulgaria 92 (0.6) V 84 (0.8) A 86 (0.9) V 81 (1.0) V 90 (0.9) V 
Croatia 90 (0.7) Vv 76 (1.0) VvV 84 (0.9) Vv 74 (1.1) / 94 (0.4) V 
Denmark’ 98 (0.2) A 84 (0.6) A 98 (0.2) A OSIEA OA A 
Estoniat 95 (0.5) 84 (0.8) A 93 (0.5 A 89 (0.8) 95 (0.4) 
Finland 05 A 76 (0.9) V 94 (04) A 93 (O'S) A 96 (0.4) 
taly 92 (0.5) V 81 (0.8) A 89 (0.5 V 79 (0.8) V 95 (0.6) 
Latvia? 96 (0.5 87 (0.8) A 90 (0.6 89 (0.6) 95 (0.4) 
Lithuania 97 (0.4) A 86 (0.7) A 91 (0.6 90 (0.7) 97 (0.4) A 
alta 93 (04) y 85 (0.6) A 89 (0.5 x 88 (0.7) 925 (05) y 
etherlands' 97 (0.3) A 71 (1.2) V 96 (0.5 A 96 (0.5) A 98 (0.4) A 
orway (9)! 98 (0.2) A A On Y 97 (0.3) A 96 (0.3) A OF (038) ZA 
Slovenia 92 (0.6) V 71 (1.1) V 88 (0.7) Vv 80 (0.9) V 95 (0.5) 
Sweden! 96 (0.4) 68 (1.2) Y EE KEE 96 (0.4) 
European ICCS 2016 average 95 (0.1) 78 (0.2) 91 (0.2 89 (0.2) 96 (0.1) 
Benchmarking participant not meeting sample participation requirements 
North-Rhine-Westphalia 97 (0.6) 74 (1.7) 94 (1.0 87 (0.9) 96 (0.7) 
(Germany)! 


National ICCS 2016 percentage: 

A More than 10 percentage points above European ICCS 2016 average 
A Significantly above European ICCS 2016 average 

V Significantly below European ICCS 2016 average 

WY More than 10 percentage points below European ICCS 2016 average 


Notes: 

() Standard errors appear in parentheses. Because results are rounded to the nearest whole number, some totals may appear inconsistent. 
(9) Country deviated from International Defined Population and surveyed adjacent upper grade. 

t+ Met guidelines for sampling participation rates only after replacement schools were included. 

1 National Defined Population covers 90% to 95% of National Target Population. 
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on providing refugees with shelter and preventing illegal immigration. Students with a higher level 
of civic knowledge showed greater support for cooperation among European countries than their 
peers with lower levels of knowledge did. 


Students generally felt positive about Europe’s future but expressed concern about some issues 


Although students expressed confidence that cooperation among European countries would 
increase and that democracy and peace would strengthen across Europe, almost half of them saw 
economic downturn and increases in poverty, unemployment, and pollution as potential problematic 
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to the future stability o 


f Europe. 


Students tended to hold positive perceptions of the European Union 
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Students were generally positive about their own lives in the future 


Overall, the surveyed students expressed optimism about their respective futures. Majorities of 
students felt confident that they would find a steady job, find a job they liked, would earn enough 
money to start a family, and would travel abroad for leisure. 
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Outlook 


The ICCS 2016 European report has provided a rich database that provides a platform for future 
research on civic and citizenship education in Europe. Together with the international results of 
CCS 2016, the European data offer researchers and other interested parties the opportunity not 
only to conduct more in-depth secondary analyses involving interpretation of the collected data 
at different levels and from different perspectives but also to address international and region- 
specific aspects of civic and citizenship education. 


ince the drafting and the administration of the ICCS 2016 European regional student 
uestionnaire, Europe has experienced mass movements of refugees to this region, the rise of 
opulism (in several countries), and potential threats to democracy, such as more vociferous racism 
nd the increase in terrorist attacks. These developments provide new challenges for civic and 
citizenship education in Europe, especially in terms of helping countries address these emerging 
issues and of sustaining the long-term aims (e.g., social cohesion, integration) of this learning area. 
The next cycle of ICCS, scheduled for 2022, will attempt to address these new developments as wel 
as changes in policy agendas directed at ensuring civic and citizenship education is an important 
area of school and out-of-school education. 
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APPENDICES 


APPENDIX A: SAMPLING INFORMATION AND PARTICIPATION 


RATES 


Table A.1: Coverage of ICCS 2016 target population 
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Country International target population Exclusions from target population 
Coverage School-level Within-sample Overall exclusions 
(%) exclusions exclusions (%) 
(%) (%) 
Belgium (Flemish) 100 4.8 0.1 49 
Bulgaria 100 1.6 0.9 25 
Croatia 100 0.5 4.6 5.2 
Denmark 100 I 27 4.4 
Estonia 100 5.1 1.6 6.7 
Finland 100 2.2 E) SE 
taly 100 0.8 3.9 48 
Latvia 100 4.3 22 6.5 
Lithuania 100 3.5 1.8 5.3: 
alta 100 1.6 02 1.8 
etherlands 100 3.0 0.9 3.9 
orway 100 ie 4.2 39 
Slovenia 100 1.8 0.8 2.7 
Sweden 100 22 43 6.4 
Benchmarking participant 
North Rhine-Westphalia 100 14 5.6 LO 
(Germany) 


Note: 
Because results are rounded to 
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APPENDICES 


APPENDIX B: STUDENT PERCENTAGES FOR DICHOTOMOUS 


VARIABLES 


Table B.1: Percentages of students in categories for dichotomous variables 
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Country Gender Immigrant status Levels of civic knowledge 
Males Females Students from Students from Civic knowledge | Civic knowledge 
immigrant non-immigrant below Level B below Level B 
family family (below 479) (below 479) 
Belgium (Flemish) 51 (1.8) 49 (1.8) 16 (1.6) 84 (1.6) 24 (1.8) 76 (1.8) 
Bulgaria* 54 (1.8) 46 (1.8) O (0.0) 100 (0.0) 45. (2:1) 55 21 
Croatia 50 (0.9) 50 (0.9) 9 (0.9) 91 (0.9) 24 (1.4) 76 (1.4) 
Denmark! 49 (0.8) 51 (0.8) 9 (0.8) 91 (0.8) NTO) 87 (1.0) 
Estonia! 50 (1.2) 50 (1.2) 9 (0.7) 91 (0.7) 20 (1.2) 80 (1.2) 
Finland 53 (1) 47 (1.1) 3105) 97 (0.5) 3 (0.8) 87 (0.8) 
taly 52 (0.9) 48 (0.9) 11 (0.9) 89 (0.9) 29 (1.2) 71 (1.2) 
Latviat 48 (1.3) SATS) 4 (0.4) 96 (0.4) 42 (1.7) 59/17) 
Lithuania 50 (0.8) 50 (0.8) 2 (0.3) 98 (0.3) 31 (1.5) 69 (1.5) 
alta 5105) 49 (0.5) 8 (0.4) 92 (0.4) 42 (1.3) 55919) 
etherlandst 49 (1.2) SCH (12) 9 (1.4) 91 (1.4) 32 (2.3) 68 (2.3) 
orway (9)! 50 (0.6) 50 (0.6) WEGEN BF D) 8 (0.8) 82 (0.8) 
Slovenia 52 (0.7) 48 (0.7) 15 (1.0) 85 (1.0) 25 (1.1) 75 (1) 
Sweden! SIERO) 49 (1.0) 18 (1.6) 82 (1.6) 7 (1.0) 83 (1.0) 
European ICCS 2016 average 50 (0.2) 50 (0.2) 9 (03) e Oz) sa OS) 66 (0.3) 
Notes: 
() Standard errors appear in parentheses. 
) Country deviated from International Defined Population and surveyed adjacent upper grade. 


National Defined Population covers 90% to 95% of National Target Population. 


(9 
+ Met guidelines for sampling participation rates only after replacement schools were included. 
1 


In the report, data related to immigrant status has not been reported because of the small number of students from immigrant 


families 
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APPENDIX C: ITEM MAPS 


The ICCS 2016 European student questionnaire used sets of items to measure constructs relevant 
inthe field of civic and citizenship education and having region-specific importance and relevance. 
Usually, sets of Likert-type items with four categories (e.g., 
“strongly disagree’). The items were then recoded so that the higher scale scores reflected more 


positive attitudes or higher frequencies. 


The Rasch Partial Credit 


odel (Masters & Wright, 1997 


“strongly agree,’ “agree, “disagree,” and 


was used for scaling, and the resulting 


weighted likelihood estimates (Warm, 1989) were transformed into a metric with a mean of 50 


and a standard deviation of 10 for equally weigh 


guidelines for sample participation. For scales equated to 


deviations were 50 and 10 respectively 
The ICCS 2016 technical report will pr 
(Schulz, Carstens, Losito, & Fraillon, fort 


The resulting ICCS 2016 scale scores can 
participating in ICCS 2016 (or ICCS 200 
extent to which students endorsed the 


ovide more detai 
hcoming). 


be interpreted wit 


of the Rasch Partial Credit Model allowed us to map sca 
possible for us to predict, for each scale score, the most likely item response for arespondent. (For 


an application of these properties in the previous survey, see Schulz & Friedman, 2011. 


Appendix C provides item maps for each questionnaire scale presented in the report. The maps 


provide a prediction of the minimum co 


predict that they would have a 50 perce 
with a particular item (see example item 


Thurstonian thresholds, the points at which a minin 
ower score and which determine the boundaries between item categories on the item map. 


ded score (eg. O 


= “agree? and 3 = “strongly agree”) a respondent would obtain on a Likert-type item based on 
their questionnaire scale score. For example, for st 
t 


This information can also be summarized at the scale leve 
across all of the corresponding scaled items. For fo 


the calculation for the second threshold, thereby allowing 
to have (on average across items) responses in the two 


a respondent with a certain scale score 


(e.g., Table 2.2 


responses in the respective lower item 


that indicate their mean values plus or minus sam 


ocated in the darker-shaded area indicate that, o 


ted ICCS 2016 national samples that satisfied 


CCS 2009, the averages and standard 


for all countries that participated in the previous survey. 


s on scaling and equating procedures 


hregard tothe average across countries 


9 where scales were equated), but they do not reveal the 
items used for measurement. However, our application 


udents with a certain scale score, one could 
nt probability of at least agreeing (or strongly agreeing) 
in Figure C.1). For each item, it is possible to determine 
num item score becomes more likely than any 


e scores to item responses, making it 


= “strongly disagree,’ 1 = “disagree” 2 


| by calculating the average thresholds 


ur-point Likert-type scales, we typically did 


us to predict how likely it would be for 


ower or upper categories. Use of this approach in the case of items measuring agreement made 
it possible to distinguish between scale scores with which respondents were most likely to agree 
or disagree with the average item used for scaling. 


n some of the reporting tables with national average scale scores, means are depicted as boxes 
pling error. The boxes are setin graphical displays 
n the main body of the text) that have two underlying colors. National average scores 
n average across items, students would have had 


categories (e.g., “agree, disagree or strongly disagree”). 


ational average scores found in the lighter-shaded area indicate that students’ average item 


responses would have been in the upper item response categories (e.g., “strongly agree”). Choice 
of thresholds between categories depended on the distributions of responses. For example, if over 
80 percent of students responded with agreement, this meant a threshold set between “strongly 


agree” and all other categories. 
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Figure C.1: Example of questionnaire item map 


Scale scores (mean = 50, standard deviation = 10) 


teri 20 30 40 50 60 70 80 
Item #2 
Item #3 
L] Strongly disagree Disagree E Agree II] Strongly agree 
Example of how to interpret the item-by-score map 
#1: | Arespondent with score 30 has more than a 50 percent probability of strongly disagreeing with 
all three items 
#2: | Arespondent with score 40 has more than a 50 percent probability of not strongly disagreeing 
with Items 1 and 2 but of strongly disagreeing with Item 3 
#3: | Arespondent with score 50 has more than a 50 percent probability of agreeing with Item 1 and 
of disagreeing with Items 2 and 3 
#4: | Arespondent with score 60 has more than a 50 percent probability of strongly agreeing with 
Item 1 and of at least agreeing with Items 2 and 3 
#5: | Arespondent with score 70 has more than a 50 percent probability of strongly agreeing with 


Items 1, 2,and3 
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Figure 2.1: Item map for the scale reflecting students’ sense of European identity 


Scores 


How much do you agree or disagree with the following 
statements? 20 30 40 50 60 70 80 


see myself as European 


feel part of Europe 


see myself first as a citizen of Europe and then as a 
citizen of the world 


Strongly disagree Disagree [W Agree $ Strongly agree 
Sum 
see myself as European 1 4 60 00 
am proud to live in Europe sl 5 50 00 
see myself first as a citizen of Europe and then as a 4 19 31 00 
citizen of the world 
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Figure 2.2: Item map for the scale reflecting students’ reports on opportunities for learning about 
Europe at school 


At school, to what extent have you had the opportunity to 
learn about the following issues or topics? 


Politica 


and economic systems of other European 


countries 


The his 


Politica 


Politica 


ory of Europe 


and social issues in other European countries 


and economic integration between European 


countries (for example the European Union) 


Politica 


countries 


The his 


Politica 


Politica 


and economic systems of other European 


ory of Europe 


and social issues in other European countries 


and economic integration between European 


countries (for example the European Union) 
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Scores 
20 30 40 50 60 70 80 
Not at al o a small extent 


RB Toa moderate extent 


I] Toalarge extent 


7 Ad 
3 14 
6 30 
7 28 
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Figure 3.1: Item map for the scale reflecting students’ attitudes toward freedom of migration within Europe 


How much do you agree or disagree with the following 
statements related to the possibilities for European 20 30 A0 50 60 70 80 
citizens to work in other European countries? 


Allowing citizens of European countries to work 
anywhere in Europe is good for the European 
economy 


Citizens of European countries should be allowed to iii 


work anywhere in Europe 


Allowing citizens of European countries to work 
anywhere in Europe helps to reduce unemployment 


Strongly disagree Disagree [M Agree $ Strongly agree 


Sum 


Allowing citizens of European countries to work 1 5 
anywhere in Europe is good for the European economy 


38 
Citizens of European countries should be allowed to 1 7 100 
work anywhere in Europe 


100 


100 


Allowing citizens of European countries to work 1 10 36 
anywhere in Europe helps to reduce unemployment 
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Figure 3.2: Item map for the scale reflecting students’ attitudes toward restricting migration within Europe 


How much do you agree or disagree with the following 


statements related to the possibilities for Euro 
citizens to work in other European countries? 


Citizens of European countries should be 
work in another European country only if 
are needed there 


Citizens of European countries who wish 


jobs that no one in the other country wan 


pean 


allowed to 
their skills 


to work in 


another country should be allowed to take only the 


stodo 


Only a limited number of people should be allowed 


to move for work from one European cou 
another 


Citizens of European countries should be 
work in another European country only if 
are needed there 


Citizens of European countries who wish 


another country should be allowed to take only the 
jobs that no one in the other country wants to do 


try to 


allowed 
their skil 


nO 


to work i 


Only a limited number of people should be allowed to 
move for work from one European country to another 


Scores 
20 30 40 50 60 70 80 
Strongly disagree Disagree [Agree [W Strongly agree 
Sum 
5 Sil 19 100 
18 45 10 100 
20 43 9 100 
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Figure 3.3: Item map for the scale reflecting students’ attitudes toward equal rights for immigrants 


How much do you agree or disagree with the following Scores 


statements about <immigrants>? 
20 30 40 50 60 70 80 


<Immigrants> should have the opportunity to 
continue speaking their own language 


<Immigrant> children should have the same 
opportunities for education that other children in the 


country have 


igran 
inue th 


igran 


s> who 


s> shou 


s> shou 


ive in a country for several years 


have the opportunity to vote in elections 


d have the opportunity to 


eir own customs and lifestyle 


dhave the same rights that 


everyone else in the country has 


Strongly disagree Disagree Hi Agree HB Strongly agree 
Sum 
<Immigrants> should have the opportunity to continue 
I i 7 24 20 00 
speaking their own language 
<Immigrant> children should have the same 
opportunities for education that other children in the 2 5 48 00 
country have 
<Immigrants> who live in a country for several years z 00 
; ° i 5 20 28 
should have the opportunity to vote in elections 
<Immigrants> should have the opportunity to continue S 00 
3 ‘ 6 20 24 
their own customs and lifestyle 
<Immigrants> should have the same rights that 3 9 45 00 
everyone else in the country has S 
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Figure 4.1: Item map for the scale reflecting students’ attitudes toward cooperation among European countries 
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Figure 4.2: Item map for the scale reflecting students’ positive expectations for European future 


Scores 


What is Europe likely to look like in 10 years? 
20 30 40 50 60 70 80 


There will be stronger cooperation among European 
countries 


THERE) Be Brent ee Ge = B 


There will be less air and water pollution in Europe 


Democracy will be strengthened across Europe. 


Very unlikely Unlikely W Likely I Very likely 


Sum 


There will be stronger cooperation among European 


There will be greater peace across Europe 5 32 1 00 


There will be less air and water pollution in Europe CL ER 10 00 


Democracy will be strengthened across Europe. 3 19 18 00 
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Figure 4.3: Item map for the scale reflecting students’ negative expectations for European future 


What is Europe likely to look like in 10 years? 


Terrorism will be more of a threat all across Europe 


Europe will be more influenced by non-European 
powers like China, India, and the United States 


The economy will be weaker in all European countries 


There will be a rise in poverty and unemployment in 
Europe 


Terrorism will be more of a threat all across Europe 


Europe will be more influenced by non-European 
powers like China, India, and the United States 


The economy will be weaker in all European countries 


There will be a rise in poverty and unemployment in 
Europe 
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Very likely E Likely Wi Unlikely [Ef Very unlikely 
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Figure 4.4: Item map for the scale reflecting students’ attitudes toward European Union 


How much do you agree or disagree with the following Scores 


statements? 
20 30 40 50 60 70 80 


<EU> guarantees respect for human rights all over 
Europe 


<EU> makes Europe a safe place to live 


<EU> is good for the economy of individual countries 


<EU> is good because countries share a common set 
f rules and laws 


° 


Strongly disagree Disagree Hi Agree HB Strongly agree 
Sum 
EU> r. De e 

<EU> guarantees respect for human rights all over j m zA 00 
Europe 
<EU> makes Europe a safe place to live 1 14 00 
<EU> takes care of the environment 2 22 00 
<EU> is good for the economy of individual countries 2 7 16 00 
<EU> is good because countries share a common set w 
of rules and laws 2 11 24 Ge 
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Figure 4.5: Item map for the scale reflecting students’ expectations for their individual future 


How likely do you think it is that your future will look 
like this? 


will find a steady job 


y financial situation will be better than that of my 
parents 


will find a job | like 


will have the opportunity to travel abroad for leisure 


will earn enough money to start a family 


will find a steady job 


y financial situation will be better than that of my 
parents 


will find a job | like 


will have the opportunity to travel abroad for leisure 


will earn enough money to start a family 


20 


30 


40 


Scores 


50 60 70 


Oo 


7 


Very unlikely Unlikely E Likely BB vey ii 
1 4 52 
1 7 47 
2 7 43 
1 3 52 
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